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DESCRIPTION 

MEDIUM SIGNAL TRANSMISSION METHOD, RECEPTION METHOD, 
TRANSMISSION/RECEPTION METHOD, AND DEVICE 

5 

TECHNICAL FIELD 
[0001] 

The present invention relates to a medium signal transmission 
method, reception method, transmission/reception method, and device, 
10 and more particularly to a method, device, and program suitable for the 
bidirectional transmission and reception of medium signals (audio and 
image) over a wired transmission line or a wireless transmission line. 
BACKGROUND ART j 
[0002] 

15 Recently, a method for transmitting highly compressed encoded 

data is used in many cases as a method for efficiently transmitting 
audio and video data. 
[0003] 

There are many methods for distributing audio/video compressed 
20 coded information to an IP (Internet Protocol) network utilizing 
packet-switching system. 
[0004] 

In case wherein such a transmission/reception of audio/video 
data is carried out over a wired IP network or an IP network that 
25 includes wireless zones, if an IP network is congested or if a wireless 
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error or loss is generated in a wireless zone, a request to retransmit the 
lost data is usually sent to request the transmission side to retransmit 
the corresponding packet. 
[0005] 

5 As a video conference terminal that improves the image quality 

by controlling the ratio of the audio bandwidth to the total 
communication bandwidth, a configuration is disclosed in which the 
encoding rate of an audio encoder is controlled based both on the image 
encoded data size, detected based on the usage capacity of the image 

10 encoding data buffer, and on the audio data encoding rate detected 
based on the usage capacity of the audio encoding data buffer (for 
example, see Patent Document 1 below). An AV 

transmission/reception system is also known that, monitors the amount 
of data stored in the receive buffer and, based on the relation between 

15 the stored data amount and the threshold, varies the receive clock 
frequency (for example, see Patent Document 2). 
[0006] 

Patent Document 1: Japanese Patent Kokai Publication No. 
JP-P200 1-33340 1A (page 4, FIG. 1) 
20 Patent Document 2: Japanese Patent Kokai Publication No. 

JP-P2002-165148 (pages 3-4, FIG. 4) 
DISCLOSURE OF THE INVENTION 
PROBLEMS TO BE SOLVED BY THE INVENTION 
[0007] 

25 However, during audio/image communication (for example, 
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f 

videophone), data cannot usually be retransmitted because the 
retransmission involves a time delay. This generates a problem that, 
when a packet is lost, the reception side suffers from quality 
degradation. 
5 [0008] 

In addition, when an image data reception device moves out of a 
wireless area (cell) and moves to an adjacent wireless area, a handover 
occurs. During this handover period, the data reception is stopped and 
a large amount of data is lost. This exhausts the output buffer of the 
10 reception device, causing the device to stop or freeze the video image 
screen and to interrupt or mute the audio. 
[0009] 

The problems similar to those described above also occur not 
only when a handover occurs between wireless zones but also when the 
15 bandwidth varies from time to time in a wired IP network. 
[0010] 

In view of the foregoing, it is an object of the present invention 
to provide a method, device, and computer program for minimizing the 
degradation of reception quality when the wait varies depending upon 
20 the time in an IP network, which includes a wired IP network and 
wireless zones, when medium signals such as videos or audios are 
distributed. 
[0011] 

It is another object of the present invention to provide a method, 
25 device, and computer program for minimizing the degradation of 
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reception quality even if a handover occurs in wireless zones. 
[0012] 

A transmission device according to one aspect of the present 
invention, which achieves the above objects, comprises an encoder unit 
5 that outputs a stream, obtained by receiving and encoding a medium 
signal, to a transmission line; and a control unit that controls the 
encoder unit to change a compression rate thereof and output the 
stream, when a predetermined control signal is received from the 
transmission line. 
10 [0013] 

A transmission device according to another aspect of the present 
invention comprises an encoder unit that outputs a stream obtained by 
receiving and encoding a medium signal; and an output control unit 
that receives the stream output from said encoder unit, and that 
15 performs control, when a predetermined control signal is received from 
said transmission line, to output the stream to the transmission line at a 
time interval different from a time interval at which the medium signal 
has been encoded by said encoder unit. 
[0014] 

20 A reception device according to one aspect of the present 

invention comprises a decoder unit that decodes a stream received from 
a transmission line; a buffer unit that stores a medium signal decoded 
and produced by the decoder unit; and a control unit that monitors a 
storage amount of the buffer unit, and that outputs a control signal to 

25 the transmission line if the storage amount of the buffer unit exceeds or 
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falls below a predetermined threshold. 
[0015] 

A reception device according to another aspect of the present 
invention comprises a decoder unit that decodes a stream received from 
5 a transmission line; a monitor unit that monitors a reception status of 
the transmission line; and a control unit that outputs a control signal to 
the transmission line based on a notification from the monitor unit if 
the reception status becomes a predetermined status. 

* 

[0016] 

10 A transmission/reception device according to one aspect of the 

present invention comprises a decoder unit that receives and decodes a 
stream; a buffer unit that stores a decoded medium signal; a first 
control unit that monitors an buffer amount, and that outputs a control 
signal to a transmission line if the buffer amount exceeds or falls 

15 below a predetermined threshold; an encoder unit that encodes a 
medium signal and outputs a stream; and a second control unit that 
controls the encoder to change a rate and output the stream, when the 
control signal is received from the transmission line. 
[0017] 

20 A transmission/reception device according to another aspect of 

the present invention comprises a buffer unit that receives and decodes 
a stream and stores a decoded medium signal; a first control unit that 
monitors a buffer amount and that outputs a control signal to a 
transmission line if the buffer amount exceeds or falls below a 

25 predetermined threshold; and a second control unit that encodes a 
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medium signal and outputs a stream, and that, when the control signal 
is received, outputs the stream at a time interval different from a time 
interval at which the medium signal has been encoded by the encoder 
unit. 
5 [0018] 

A transmission/reception device according to another aspect of 
the present invention comprises a decoder unit that receives and 
decodes a stream; a monitor unit that monitors a reception status; a 
first control unit that that outputs a control signal to a transmission 

10 line if the reception status becomes a predetermined status; an encoder 
unit that encodes a medium signal and outputs a stream; and a second 
control unit that outputs a stream at a time interval different from a 
time interval at which the input signal is encoded when the control 
signal is received from the transmission line. 

15 [0019] 

A transmission method according to the present invention is a 
method for outputting a stream, obtained by receiving and encoding a 
medium signal, to a transmission line, wherein the method may be 
controlled in such a way that the stream is output by changing a 

20 compression rate of the encoding processing when a predetermined 
control signal is received from the transmission line, or in such a way 
the stream is output to the transmission line at a time interval different 
from a time interval at which the medium signal has been encoded when 
the predetermined control signal is received from the transmission line. 

25 [0020] 
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A reception method according to the present invention comprises 
the steps of receiving and decoding a stream; monitoring a storage 
amount of a buffer unit in which a medium signal obtained by the 
decoding is stored, and outputting a control signal to the transmission 
5 line if the storage amount of the buffer unit exceeds or falls below a 
predetermined threshold or based on a monitoring result of a reception 
status. 

MERITORIOUS EFFECT OF THE INVENTION 
[0021] 

10 The present invention minimizes a distortion in the image 

quality or sound quality in the bidirectional wireless communication of 
moving images even if a handover occurs in a wireless interval on an 
image reception device side or the reception status changes over time 
because of congestion or a packet loss in a wireless network or an IP 

15 network. 
[0022] 

In addition, the present invention, which gives the effect 
described above, reduces the processing amount on both the 
transmission side and the reception side. 
20 BRIEF DESCRIPTION OF THE DRAWINGS 
[0023] 

FIG. 1 is a diagram showing the configuration of an image data 
distribution device (transmission device) in a first embodiment of the 
present invention. 

25 FIG. 2 is a diagram showing the configuration of an image data 
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distribution device (transmission device) in a second embodiment of 
the present invention. 

FIG. 3 is a diagram showing the configuration of an image data 
distribution system in a third embodiment of the present invention. 
5 FIG. 4 is a diagram showing the configuration of an image data 

distribution system in a fourth embodiment of the present invention. 

FIG. 5 is a diagram showing the configuration of an image data 
distribution system in a fifth embodiment of the present invention. 

FIG. 6 is a diagram showing the configuration of an image data 
10 distribution system in a sixth embodiment of the present invention. 
EXPLANATION OF NUMERALS 
[0024] 



101, 101A an image data distribution device 

102 control unit 

15 104 encoder 

106 transmission line 

107,107A image data reception device 

108 control unit 

109 image encoded data reception unit 
20 110 wireless status determination unit 

111 buffer unit 

112 decoder 
120 image signal 
121, 122, 123 control signal 

25 204 image stream output control unit 
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BEST MODE FOR CARRYING OUT THE INVENTION 
[0025] 

Embodiments of the present invention will be described. The 
transmission side of a transmission/reception device in one embodiment 
5 of the present invention comprises an encoder (102) that receives and 
encodes a medium signal, including images and/or audios, as an input, 
and create distribution data to outputs the distribution data as a stream; 
and a control unit 102 that changes the compression rate of the encoder 
(102) when a control signal (121) is received from a transmission line 
10 (106). 
[0026] 

In another embodiment of the present invention, the 
transmission side may be configured to have an output control unit 
(204) that controls to output the stream at a time interval different 
15 from a time interval at which the input (source) is encoded, when a 
control signal (121) is received from a transmission line (106). 
[0027] 

In one embodiment of the present invention, the reception side 
comprises a control unit (108) that monitors the storage amount of a 
20 buffer unit (111) that stores a medium signal obtained on decoding a 
stream by a decoder (112), and outputs a control signal (123) to a 
transmission line if the storage amount of the buffer unit exceeds or 
falls below a predetermined threshold. 
[0028] 

25 In another embodiment of the present invention, the reception 
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side may monitor a reception status and, based on the monitor result, 
outputs a control signal (123) to a transmission line when a handover is 
detected based. 
[0029] 

5 The following describes a transmission method in one 

embodiment of the present invention. The transmission method in one 
embodiment of the present invention includes steps Al and A2 
described below. 
[0030] 

10 Step Al: A medium signal is received and encoded by an encoder 

to create distribution data and output a stream. 
[0031] 

Step A2: When a predetermined control signal is received from a 
transmission line, control is performed to change the compression rate 
15 of the encoder and output the stream. 
[0032] 

A transmission method in another embodiment of the present 
invention includes steps All and A12 described below. 
[0033] 

20 Step All: A medium signal is received and encoded by an 

encoder to create distribution data and output a stream. 
[0034] 

A12: In case of outputting the stream encoded by the encoder to 
a transmission line, when a predetermined control signal is received 
25 from the transmission line, output control of the stream is performed so 



11 

that the stream is output at a time interval different from a time 
interval at which the received media signal has been encoded by the 
encoder. 
[0035] 

5 A reception method in one embodiment of the present invention 

includes steps Bl and B2 described below. 
[0036] 

Step Bl: A stream transmitted to a transmission line is received 
and the stream is decoded. 
10 [0037] 

Step B2: The storage amount of a buffer that stores a medium 
signal, obtained by the decoding, is monitored and a control signal to 
the transmission line is output if the storage amount of the buffer 
exceeds or falls below a predetermined threshold. 
15 [0038] 

A reception method in another embodiment of the present 
invention includes steps Bll and B12 described below. 
[0039] 

Step Bll: A stream transmitted to a transmission line is received 
20 and the stream is decoded. 
[0040] 

Step B12: The reception status of the transmission line is 
monitored and, if the reception status becomes a predetermined status, 
a control signal is output to the transmission line based on a 
25 notification from the monitor unit. 
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[0041] 

Another transmission/reception method according to the present 
invention is suitable for bidirectional medium transmission/reception, 
the transmission side includes steps Al and A2 or All and A12, 
5 described above, and the reception side includes steps Bl and B2 or 
steps Bll and B12. 
[0042] 

The processing/function of steps Al, A2, All, and A12 may be 
implemented by a program executed by a computer (or processor) on 
10 the transmission side. 
[0043] 

The processing/function of steps Bl, B2, Bll, and B12 may be 
implemented by a program executed by a computer (or processor) on 
the transmission side. 
15 EMBODIMENTS 
[0044] 

The following describes the present invention with reference to 
the attached drawings to describe it more in detail. FIG. 1 is a 
diagram showing the configuration of a first embodiment of the present 

20 invention. It is assumed that image and/or audio data is transmitted 
by UDP/IP via a transmission line 106 on which IP (Internet Protocol) 
is being built on a wireless physical layer. An image data reception 
device not shown is, for example, a client terminal, connected to a 
wireless IP network, to receive image encoded data using UDP (User 

25 Datagram Protocol)/IP. 
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[0045] 

Referring to FIG. 1, an image data distribution (transmission) 
device 101 comprises an encoder 104 for encoding a received image 
signal and a control unit 102. The encoder 104 (also called a 
5 "streaming encoder") encodes a received image signal 120 at a 
predetermined bit rate and outputs it to the transmission line 106 as a 
stream. The image signal or the like received may be a file or, in case 
of live distribution, data from a camera or the like. 
[0046] 

♦ . 

10 When a control signal 121 is received from the transmission line 

106, the control unit 102 outputs a control signal 122, which changes 
the bit rate of image data, to the encoder 104, and the encoder 104 
changes the encoding bit rate (compression rate) of the image data (for 
example, changes the rate to a lower bit rate) according to the control 

15 signal 122 and then outputs the image data to the transmission line 106. 
In this embodiment, the image data reception device, not shown, 
transmits the control signal to the transmission line 106 when there is a 
possibility that the receive buffer of image encoded data is going to be 
exhausted. The transmission line 106, on which IP (Internet Protocol) 

20 is assumed to be built on the wireless physical layer, uses UDP/IP as 
the transmission protocol. As the control signal, RTCP (Real Time 
Transport Protocol) defined by IETF (Internet Engineering Task Force) 
as RFC, an extended version of RTCP being drafted by IETF, or RTSP 
(Real Time Streaming Protocol) defined by IETF as RFC (Request For 

25 Comments) may be used. This applies also to the embodiments given 
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below. 
[0047] 

Although the transmission device (distribution device) and the 
reception device are described as separate devices in FIG. 1 to simplify 
5 the description, it is also possible that both the transmission function 
and the reception function are mounted in one device as a 
transmission/reception device. In this case, both functions of the 
transmission device and the reception device described in this 
embodiment are implemented by one device. This applies also to the 
10 embodiments given below. 
[0048] 

FIG. 2 is a diagram showing the configuration of a second 
embodiment of the present invention. Referring to FIG. 2, an image 
data distribution device 101A in this embodiment has the configuration 

15 of the image data distribution device 101 in FIG. 1 to which an image 
stream output control unit 204 is added. An encoder 104 encodes a 
received image signal at a predetermined bit rate and outputs the image 
signal to a transmission line 106 as a stream. When a control signal 
121 is received from the transmission line 106, the control unit 102 

20 outputs a control signal 122 to the image stream output control unit 
204. 
[0049] 

When the control signal 122 is received from the control unit 
102, the image stream output control unit 204 reads the image encoded 
25 data at a time interval T at which the data is encoded by the encoder 
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104 or at a time interval T' different from the clock T, or with a 
different clock T', and outputs the data to the transmission line 106. 
[0050] 

FIG. 3 is a diagram showing the configuration of a third 
5 embodiment of the present invention. Referring to FIG. 3, an image 
data distribution device 101 has a configuration similar to that of the 
image data distribution device 101 shown in FIG. 1. 
[0051] 

An image data reception device 107 receives image encoded data 
10 from a transmission line 106 via an image encoded data reception unit 
109, temporarily stores the data in a buffer unit (storage device) 111 
and, after absorbing packet fluctuation and delay in arrival of packet 
on the transmission line 106, outputs the data to a decoder 112. The 
buffer unit 111 has a buffer (storage unit) for storing the medium signal 
15 decoded by the decoder 112. 
[0052] 

Although the buffer unit 111, in which the received image 
encoded data is temporarily stored, is provided externally to the image 
encoded data reception unit 109 for the clarity of description, it is of 
20 course possible to configure a buffer, in which image encoded data is 
temporarily stored, in the image encoded data reception unit 109. In 
this case, the image encoded data is supplied from the image encoded 
data reception unit 109 to the decoder 112, and the buffer unit 111 in 

r 

FIG. 3 has a buffer only for storing the medium signal decoded by the 
25 decoder 112. The image signal decoded by the decoder 112 is 
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displayed on a display device not shown. 
[0053] 

A control unit 108 measures the storage amount of a buffer, in 
which the decoded medium signal is stored, at a predetermined time 
5 interval and, when the storage amount of the buffer in which the 
decoded medium signal is stored is going to be exhausted, transmits a 
control signal 123 to the transmission line 106. It is also possible for 
the control unit 108 to compare the storage amount of the buffer, in 
which the decoded medium signal is stored, with a predetermined upper 

10 or lower threshold to determine if the buffer is exhausted. As a 
modification of this embodiment, it is also possible that the control 
unit 108 controls the output of the control signal 123 based on the 
storage amount of the buffer in which the received image encoded data 
is temporarily stored. 

15 [0054] 

When a control signal 121 is received from the image data 
reception device 107 via the transmission line 106, a control unit 102 
of the image data distribution device 101 outputs a control signal 122 
to an encoder 104, changes the bit rate (compression rate) of the 

20 encoder 104 (for example, to a lower bit rate), and outputs the data to 
the transmission line 106. Again, in this embodiment, the 
transmission line 106 on which IP (Internet Protocol) is assumed to be 
built on the wireless physical layer, uses UDP/IP as the transmission 
protocol. Note that the control signal 121 received by the image data 

25 distribution device 101 and the control signal 123 transmitted from the 
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image data reception device 107 are the same control signal. 
[0055] 

FIG. 4 is a diagram shpwing the configuration of a fourth 
embodiment of the present invention. Referring to FIG. 4, an image 
5 data reception device 107 has a configuration similar to that of the 
image data reception device 107 shown in FIG. 3. An image data 
distribution device 101A shown in FIG. 4 has a configuration similar to 
that of the image data distribution device 101A shown in FIG. 2. 
[0056] 

10 A control unit 108 of the image data reception device 107 

measures the buffer amount of an encoded data buffer unit 111 at a 
predetermined time interval and, when the encoded data buffer unit 111 
is going to be exhausted, transmits a control signal 123 to a 
transmission line 106. 

15 [0057] 

When a control signal 121 is received from the image data 
reception device 107 via the transmission line 106, a control unit 102 
of the image data distribution device 101 outputs a control signal 122 
to an image stream output control unit 204. The image stream output 

20 control unit 204 reads the image encoded data at a time interval T at 
which the data is encoded by an encoder 104, or at a time interval T' 
different from the clock T, or with a different clock T', and outputs the 
data to the transmission line 106. Note that, in FIG. 4, the control 
signal 121 received by the image data distribution device 101A and the 

25 control signal 123 transmitted from the image data reception device 
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107 are the same control signal. 
[0058] 

FIG. 5 is a diagram showing the configuration of a fifth 
embodiment of the present invention. Referring to FIG. 5, an image 
5 data distribution device 101 has a configuration simitar to that of the 
image data distribution device 101 in FIG. 1. The configuration of an 
image data reception device 107A is similar to that of the image data 
reception device 107 shown in FIG. 3 except that a wireless status 
determination unit 110 is added. 
10 [0059] 

The wireless status determination unit 110 of the image data 
reception device 107A monitors the wireless reception status of a 
transmission line 106 and, when the reception status becomes a 
predetermined status, notifies a control unit 108 about the status, and 

15 causes the control unit 108 to output a control signal 123 to the 
transmission line 106. When a control signal 121 (buffer exhaustion 
status) is received from the image data reception device 107A via the 
transmission line 106, a control unit 102 of the image data distribution 
device 101 outputs a control signal 122 to an encoder 104, changes the 

20 encoding bit rate (compression rate) of the encoder 104, and outputs 
the data to the transmission line 106. In response to the control signal 
122, the encoder 104 changes the bit rate, for example, to a lower bit 
rate. In FIG. 5, note that the control signal 121 received by the image 
data distribution device 101 and the control signal 123 transmitted 

25 from the image data reception device 107A are the same control signal. 
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[0060] 

FIG. 6 is a diagram showing the configuration of a sixth 
embodiment of the present invention. Referring to FIG. 6, an image 
data distribution device 101A has a configuration similar to that of the 
5 image data distribution device 101A shown in FIG. 2. An image data 
reception device 107A is similar to the image data reception device 
107A shown in FIG. 5. 
[0061] 

* 

A wireless status determination unit 110 of the image data 

10 reception device 107A monitors the wireless reception status of a 
transmission line 106 and, when the reception status becomes a 
predetermined status, notifies a control unit 108 about the status, and 
causes the control unit 108 to output a control signal 123 to the 
transmission line 106. When a control signal 121 is received from the 

15 image data reception device 107A via the transmission line 106, a 
control unit 102 of the image data distribution device 101A outputs a 
control signal 122 to an image stream output control unit 204. The 
image stream output control unit 204 reads the image encoded data at a 
time interval T at which the data is encoded by the encoder 104 or at a 

20 time interval T' different from the clock T, or with a different clock T', 
and outputs the data to the transmission line 106. In FIG. 6, note that 
the control signal 121 received by the image data distribution device 
101A and the control signal 123 transmitted from the image data 
reception device 107A are the same control signal. 

25 [0062] 
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The wireless status determination unit 110 may be composed by 
a handover determination unit that monitors the wireless reception 
status of the transmission line 106 and notifies the status to the control 
unit 108, if the wireless status indicates that a handover that 
5 determines a handover from the current wireless area (cell) to an 
adjacent cell occurs. 
[0063] 

Although the present invention has been described with 
reference to the preferred embodiments given above, it is apparent that 
10 the present invention is not limited to the configuration of the above 
embodiments but that various modifications and changes in accordance 
with the principle of the present invention are included. 



